Physical realizability of small-world networks. 
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Supplementing a lattice with long-range connections effectively models small-world networks char- 
acterized by a high local and global interconnectedness observed in systems ranging from society 
to the brain. If the links have a wiring cost associated to their length I, the corresponding distri- 
bution q(l) plays a crucial role. Uniform length distributions have received most attention despite 
indications that q(l) ~ l~ a exist, e.g. for integrated circuits, the Internet and cortical networks. 
While length distributions of this type were previously examined in the context of navigability, we 
here discuss for such systems the emergence and physical realizability of small-world topology. Our 
simple argument allows to understand under which condition and at what expense a small world 
results. 
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The explosion of research activity in the field of com- 
plex networks has led to a novel framework in order to 
describe systems in disciplines ranging from the social 
sciences to biology pj. One feature shared by most real 
networks is the small-world (SW) property involving a 
high degree of interconnectedness both at a local and 
global level. That is, for every node, most nodes close 
to it should also be close to each other and every pair 
of nodes is separated, on average, by only a few links 
0- More precisely, the latter is usually expressed with 
an at most logarithmic increase of the mean distance as 
a function of the system size. Although the SW phe- 
nomenon has first been introduced in a social context , 
it is also relevant for communication and technological 
systems such as the Internet Q or electronic circuits 
Small-world properties are of great relevance for commu- 
nication systems: SW networks are particularly efficient 
for message passing protocols that rely only on the lo- 
cal knowledge of the network available to each node @. 
It has also been pointed out recently that SW networks 
could describe the architecture of neuronal networks: in 
vitro neuronal networks , brain functional networks Q 
as well as the cerebral cortex exhibit SW features. In 
fact, the topology plays a crucial role in a neural network, 
since the high local interconnectedness gives rise to co- 
herent oscillations while short global distances ensure a 
fast system response [To| . 

To model SW networks in Euclidean space, one starts 
with a regular lattice which is highly interconnected lo- 
cally and then rewires every link (connecting nodes A and 
B) with probability p, that is the edge between the ver- 
tices A and B is replaced by a long-range connection (or 
shortcut) between the nodes A and C, C being chosen at 
random 2] . Clearly, the short global distances are due to 
the presence of shortcuts, and as described in more detail 
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below, it is the aim of this paper to investigate the phys- 
ical realizability of a SW network. In the above model, p 
allows to interpolate continuously between a fully regu- 
lar (p = 0) and an entirely random (p = 1) topology, the 
precise nature of this transition being discussed below. If 
the shortcuts are merely added (without losing local con- 
nections), no significant changes in the emergence of the 
SW topology result. We therefore deal with the model 
where re-wiring is not accompanied by edge removal. 

In the original formulation of the SW model, which 
received most of the attention E2> the length distribu- 
tion of the shortcuts is uniform, since a node can choose 
any other node to establish a shortcut, irrespective of 
their Euclidean distance. Yet, new interesting properties 
emerge if this condition is relaxed, for example if the dis- 
tribution q(l) of connection lengths I decays as a power 
law, q(l) ~ l~ a . The navigability in such a small world, 
for example, depends on the decay exponent a |l2j |. and 
the nature of random walks and diffusion over the net- 
work is also affected 0, It was even conjectured 
that the fundamental mechanism behind the SW phe- 
nomenon is neither disorder nor randomness, but rather 
the presence of multiple length scales EU in agreement 
with q(l) ~ l~ a . Here we establish the properties of the 
wiring mechanism which allows to realize SW networks, 
the improved navigability being a consequence of the SW 
property 

Real SW networks are unlikely to be successfully mod- 
eled according to Watts and Strogatz' recipe given above: 
if shortcuts have to be physically realized, the cost of a 
long-range connection is likely to grow with its length. 
Since nodes connected by shortcuts can be at any Eu- 
clidean distance from each other, it turns out that the 
amount of resources that they have to invest in their 
connections grows linearly with the linear system size, 
and it is, a priori, unpredictable. This is far from op- 
timal for systems composed by entities with limited re- 
sources {e.g. providers or neurons). Indeed, local (sin- 
gle node) and global wiring cost considerations are likely 
to be key factors in the formation of real SW networks 
El Olll El H E3 Regarding connection-length dis- 
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FIG. 1: Mean distance versus linear system size, both of these 
quantities being rescaled by L^(p), for p — 0.001 (o), p — 
0.002 (□), p = 0.004 (A), p = 0.008 (o) and p = 0.016 (V). 
The exponent a ranges from to 3.5 as indicated. The data 
collapses confirm Eqs. and Q also for a > a c (lower right 
panel) . 



tributions q(l) ~ such measurements were reported 
for systems created through self-organization, design and 
evolution, namely for the Internet |2l| , integrated circuits 
[22| , the human cortex [2j| and for regions of the human 
brain correlated at the functional level Some mod- 
eling effort taking into account the constraint of wiring 
minimization has been made for systems where the con- 
nection lengths are 1241 or are not distributed according 
to a power law |25l l26t 127} . and such length distribu- 
tions emerge quite naturally when wiring costs along with 
shortest paths are minimized psj . 

In this work we re-analyze the SW phenomenon from 
a wiring cost perspective, for networks in D dimensions, 
built using a power-law decaying distribution of short- 
cut lengths. We find, both analytically and numerically, 
that a < D + 1 is the condition for the emergence of SW 
behavior. We also found that the local interconnected- 
ness increases with a and, given a fixed total wiring cost, 
networks with larger values of a are smaller worlds. 

Given a .D-dimensional lattice of linear size L, con- 
sisting of TV = L D sites, subject to periodic boundary 
conditions, it shall be supplemented with pN additional 
connections whose lengths are distributed according to 
q(l) ~ l~ a as follows: for every link to be added, we first 
choose its length according to the (one-dimensional) dis- 
tribution q(l) and then put it on the lattice by randomly 
choosing one endpoint and the other at the drawn dis- 
tance Z, such that no pair of sites is connected by more 
than one additional connection. 

Clearly a certain amount of real shortcuts, i.e. long 
additional links, is required for SW topology to emerge 
0, 001 ■ It can thus be anticipated that the exponent a 
has to be smaller than a critical value a c . Before we give 



the argument allowing to derive cv c , let us recall that SW 
topology is characterized by the following behavior of the 
mean distance 



(d)=L*T a (±), 
the scaling function obeying [3ll l32l | 
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In other words, SW topology corresponds to a logarith- 
mic increase of the mean distance with the system size 
(L 3> L*) whereas in a large world (LW), i.e. if L <C L* , 
(d) ~ L. For a = 0, the critical length scale in Eq. is 
given by L*(p) ~ p~ x l D j3^,|3i|. If a is positive, we shall 
derive L* (as well as a c ) through the following indirect 
argument: We look at the probability that an arbitrarily 
chosen additional link is a real shortcut, that is, that it 
spans the lattice, 



,L/2 

P C (L) = / q(l)dl, 

J(l-c)L/2 



(3) 



c being small but finite, and require (our ansatz) the 
expected number of such connections to be of the order 
of 1 IH: 



P c (L)[p*(L)L D ] ~1. 



(4) 



Here p*(L)L D is the desired number of additional links, 
implying the emergence of SW topology for p 3> p*(L). 
After evaluating the scaling of ©, Eq. (0J reads 



p*(L) ~ { ln(L)/^ 



L 



t-D-l 



if a < 1, 
if a = 1, 
if a > 1. 



(5) 



Eq. © implies L*(p) ~ p X I D for a < 1, i.e. the behavior 
of L* in this a-range is the same as that for a — 0. In the 



case a > 1, we have L*(p) 
infinite at 



P 



l/(a-D-l) 



a c = D + 1. 



thus becoming 



(0) 



We therefore have two possible regimes for a < a c while 
LW behavior prevails for a > a c . Fig. ^ shows the 
rescaled mean distances as a function of the rescaled 
linear system size for different values of a and p — 
0.001, 0.002, 0.016 in each set for the case D = 2. The 
observed data collapses for all the chosen values of a con- 
firm Eq. JSJ) obtained by our simple argument as well as 
Eq. . We numerically verified Eq. (j2J , especially in the 
limit L/L* <C 1, the logarithmic tail of J- a further being 
exhibited best for small a 0. 

As outlined above, a SW network is also character- 
ized by a high local interconnectedness. This topological 
property can for example be measured by the clustering 
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coefficient C which is the probability that two nodes are 
connected, given that they share a nearest neighbor. In 
contrast to Watts and Strogatz' model, our initial lat- 
tices are characterized by C — 0, but by increasing the 
exponent of the link-length distribution, the degree of 
clustering becomes orders of magnitudes larger than for 
random networks with the same number of nodes and 
links. 

Let us now examine the wiring costs, which were our 
prime motivation to look at SW networks with power- 
law decaying link-length distributions, and an important 
ingredient for real SW networks. The moments (I) and 
(I 2 ) play a crucial role as far as these costs are concerned. 
Indeed, finite (/) and (I 2 ) would allow for predictable 
costs for each node, and consequently for a better de- 
sign of the network constituents. The total wiring cost 
Cw = pL D (I) is also an important quantity, its minimi- 
sation governing, for example, the evolution of cortical 
networks ^t|- We find for the first two moments the 
scaling relations summarised in Tab. [I] the expressions 
for integer a being modified by logarithmic corrections. 
In 2 dimensions, SW topology can be realized even if 
(/) = const (that is, for 2 < a < 3 = a c ) whereas this 
is not the case in 1 dimension where (l) becomes finite 
in the L — > oo limit only above a c = 2. Moreover, if 
D = 3, it is even possible to have (I) — 0(1) = (I 2 ) while 
still being in the SW regime for 3 < a < 4 = a c . An 
appropriate choice of the parameters D and a is thus the 
key to modeling networks which are both efficient (SW 
topology) and economical (low wiring costs). 

It is furthermore interesting to have a closer look at 
the relationship between the wiring costs and the topol- 
ogy. As a varies, one can ask what mean distance results 
given a total amount of wiring length for the additional 
connections (i.e. the total cost). Fig. |2Ji reports these 
dependencies for a = 0, 1, 1.5 and 1.75 (going from the 
uppermost to the lowest set) for 1 dimensional topologies 
of 10 4 sites. The largest value of (d) (the leftmost circle) 
corresponds to the length scale L* < 10 3 <C 10 4 = L, 
thus all the points in the figure represent the system in 
the SW regime. It can clearly be seen that the mean 
distance decreases with a at fixed wiring costs Cw/N, 
i.e. the larger a the smaller the world. This behavior is 
qualitatively recovered when expressing Eq. Q in terms 
of x = Cw/N = p(l). We made similar observations in 2 
dimensions (see Fig. 03). 

Let us now point out the generality of our argument for 
the realizability of SW networks in Euclidean space. In 



TABLE I: Behavior of the moments of the shortcut-length 
distribution as a function of the linear system size L (for the 
"adding" procedure 1). 
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FIG. 2: (a) Mean distance as a function of the total wiring 
costs (divided by the number of sites) for 1 dimensional 
topologies (N — 10 4 ). The curves (o: a — 0, A: a = 1, 
o: q = 1.5 and □: a = 1.75) show that the mean distance 
decreases with a for a fixed value of Cw/N. (b) Analogous 
results for D = 2 [N = 500 x 500 and a = (o), a = 1 
(□) and q = 2 («)]. All the points shown here result from 
averaging over 100 realizations of networks. 



fact, it also applies to a version of the SW model where 
the links are added in a different way: at every site, a 
link is added with probability p - the other endpoint being 
chosen according to the (D-dimcnsional) distribution q(l) 
pflj . This procedure differs from the previous one in that 
the site from which the new link will emanate "sees" the 
dimensionality of the lattice, giving rise to a different 
normalization of q(l) with respect to the version treated 
above. Furthermore, the just described mechanism is 
equivalent to adding a link between any pair of sites x 
and y with a probability proportional to |x — y| _a |3(l |. 

For this new construction procedure, the length distri- 
bution reads 



1(1) 



D-l- 



L / 2 lD-l- 



"dl 



where the factor l D ~ 1 explicitly accounts for the nor- 
malization in D-dimensional space. With Eqs. 10) and 
which do not depend on the details of the "adding" 
mechanism, we obtain for the critical probability 



P*(L) 



Conversely, this implies L* 




P 



if a < D, 
if a = D, 
if a > D. 

l/( a -2D) for a> D and 



hence the existence of a SW regime as long as 
a c < 2D 



(7) 



in analogy with the previous reasoning. Inequality l(7)l 
had already been derived [2^, |3(| , but in a less intuitive 
framework. 

In summary, we have given a simple argument leading 
to the precise conditions under which small-world topol- 
ogy emerges, and examined the physical realizability of 
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such networks. Due to the generality of our argument, 
it is also applicable to other small-world models. We 
further showed that small-world networks can be con- 
structed in a very economical way if the parameters D 
and a are chosen appropriately (although of course in 
real systems D is seldom a tunable parameter) . As length 
distributions of the type investigated here have been ob- 
served in a number of real- world networks, such as in- 



tegrated circuits, the Internet or the human cortex, we 
believe this work to have intriguing implications in their 
modeling. 
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